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(57) ABSTRACT 

This invention provides a multi-screen display system, 
which unifies the control relating to each image on a 
multi-screen. The multi-screen display system receives 
images from a plurality of image sources, and displays the 
received images at the same time on the multi-screen of a 
display device. In the multi -screen display system, a multi- 
screen control part determines a type of each image source 
and a display region where a multi-screen control cursor is 
positioned on the multi-screen. The multi-screen control part 
determines a role of the multi-screen control cursor in the 
display region according to the type of the image source of 
an image displayed in the display region where the multi- 
screen control cursor is positioned. The multi-screen control 
part controls generation of the multi-screen control cursor 
and the operation thereof so that the multi-screen control 
cursor can play the determined role. 
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MULTI-SCREEN DISPLAY SYSTEM AND control cursor is positioned, and wherein the cursor control 

METHOD means determines a role of the multi-screen control cursor in 

the display region where the multi-screen control cursor is 
positioned according to a type of an image source of an 
BACKGROUND OF THE INVENTION 5 image displayed in the display region, and the cursor control 

v m f k means controls generation of the multi-screen control cursor 

1. Held ot tne Invention and me opcratioD tij Crco f ^ mat mc multi-screen control 
The present invention relates in general to a multi-screen cursor can play the determined role. 

display system and method, which enables the simultaneous ^ me unified of me im on the 
display of image data inputted from a plurality of image 10 multi-screen 

sources on a display unit ~ ./ ... . - . . . 

' The multi-screen display system is preferably cbaracter- 

2. Description of Related Art ized in that the plurality of image sources includes at least 
In recent years, image data supplied from a DTV (digital one image source providing an interactive operational 

television) and a DVD (digital video disk), a PC personal environment, and the cursor control means sets a role of the 
computer and the like are increasingly displayed on a 15 multi-screen control cursor corresponding to the interactive 
multi-screen of a large display unit such as a liquid crystal operational environment when an image source of an image 
projector and a plasma display. Accordingly, there is the displayed in the display region where the multi-screen 
necessity of displaying a combination of image data sup- control cursor is positioned provides the interactive opera- 
plied from different image media on this large display unit, tional environment. This enables the control to be achieved 
which is regarded as a central device for multimedia, in 20 on tne mu lti-screen suitably for the interactive operational 
homes. Therefore, the image display system needs to have a environment. 

function of displaying a plurality of images at the same time. mu iti-screen display-system is preferably cbaracter- 
A currently proposed large display unit has a function of ^ m tnat me at least one image ^^^^ prov iding the 
arbitrarily arranging and displaying, on a screen, the image interactive operational environment has a cursor generation 
data supplied from a plurality of different media connected 25 controlling function of generating a cursor on the at least one 
thereto to thereby display a plurality of image data at the and controlling operation of the cursor, and the 
same time. More specifically, a multi-screen display system cursor control means has control transfer means operable if 
is constructed by using the large display unit as a multi- me image source of me displayed in the display 
screen viewer. region where the multi-screen control cursor is positioned 
If, however, PC image data are displayed on the screen of has the cursor generation controlling function, for transfer- 
the above-mentioned conventional multi-screen display ring control relating to the generation and operation of the 
system, the image data should be edited and changed by multi-screen control cursor to the cursor generation control- 
operating a cursor or mouse of a PC. This is because a cursor ling function of the image source having the cursor genera- 
generating means and an application control are provided tion controlling function so that the multi-screen control 
inside the PC. If a broadcast image of an interactive inte- 35 cursor is switched to the cursor generated by the image 
grated digital broadcasting system, etc. is laid out as a part source having the cursor generation controlling function, 
of a display on a multi-screen, the resolution of the image is The edition and change of the images at the image source 
converted to a resolution intended by a broadcasting station side having the cursor generation controlling function can be 
and then an action must be taken to change the display on the performed on the multi-screen, not at the image source side, 
broadcasting screen. This is because currently-expected The image source having the cursor generation control- 
broadcast images construct a menu screen with the resolu- ii ng function is an information processing apparatus includ- 
tion intended by the broadcasting station. If the user converts mg a personal computer and a workstation, 
the resolution to display the multi-screen, an interactive ^ multi-screen display system is preferably character- 
selection and the like may become impossible. For this M in that ^ image having lhe generation 
reason, the conventional multi-screen display system is not controlling function is provided with a serial bus, and the 
capable of performing the unified control of different media control means has a xM bus OTrm ected to the serial 
by using the large display unit as a central control means. In 5us of mc ^ gc saaaX9 and me ^otTol transfer means 
other words, a user interface cannot be operated easily. reconstructs the connection of the serial bus of the cursor 

SUMMARY OF THE INVENTION 50 means and the serial bus of the image source while 

the image source is operating, and then transfers the control 

It is therefore an object of the present invention to provide relating to the generation and operation of the multi-screen 

a multi-screen display system and method that realizes the control cursor to the cursor generation controlling function 

unified control relating to each image on the multi-screen. of the image source. 

The above object can be accomplished by providing a 55 Therefore, the control relating to the generation and 
multi-screen display system comprising input means far operation of the cursor can easily be transferred to the cursor 
inputting images from a plurality of image sources, display generation controlling function of the image source, 
means having a multi-screen capable* of displaying the The serial bus of me image source and the serial bus of the 
inputted images, image source determining means for deter- cursor control means are universal serial buses or serial 
mining a type of each of the image sources, layout deter- 60 buses conforming to an IEEE 1394 standard, 
mining means for determining a layout of display regions for The multi-screen display system is preferably character- 
arranging the inputted images on the multi-screen of the ized in that the plurality of image sources includes at least 
display means, cursor control means for generating a multi- one image source having a cursor generation controlling 
screen control cursor for inputting commands on the multi- function of controlling the cursor control means to generate 
screen and controlling operation thereof, and display region 65 an interactive cursor for moving and changing exclusively 
identifying means for identifying a display region on the interactive select buttons, and if the image source of the 
multi-screen of the display means in which the multi-screen image displayed in the display region where the multi-screen 
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control cursor is positioned has the cursor generation con- 
trolling function, the cursor control means turns off a display 
of the multi-screen control cursor to generate the interactive 
cursor according to the cursor generation controlling func- 
tion of the image source and controls operation of the 5 
interactive cursor. Therefore, image sources can be changed 
on the multi-screen. 

The multi-screen display system is preferably character- 
ized in that the plurality of image sources includes at least 
one image source having a cursor generation controlling 10 
function of controlling the cursor control means to generate 
the multi-screen control cursor, and if the image source of 
the image displayed in the display region where the multi- 
screen control cursor is positioned has the cursor generation 
controlling function, the cursor control means generates the 15 
multi-screen control cursor according to the cursor genera- 
tion controlling function of the image source and changes 
size, color and movement amount of the multi-screen con- 
trol cursor according to a resolution of the display region 
where the image of the image source having the cursor 20 
generation controlling function is displayed. The cursor can 
be operated in a comfortable manner suitable for the screen. 

The image source having the cursor generation control- 
ling function provides a digital broadcasting according to an 
integrated digital broadcasting system. 25 

The multi-screen display system is preferably character- 
ized in that if the multi-screen control cursor on the multi- 
screen is located in a display region of the digital broad- 
casting according to the integrated digital broadcasting ^ 
system, the cursor control means converts a position of the 
multi-screen control cursor to a position desired by a pro- 
vider of the integrated digital broadcasting system, and 
wherein if the converted position of the multi-screen control 
cursor is within a region of a button property of changing 35 
interactive scenes, the cursor control means takes an action 
to change scenes according to a scenario of the digital 
broadcasting when received. Therefore, the scenes can be 
changed without fail. 

The above object can be accomplished by a multi-screen ^ 
display method which comprises a receiving step of receiv- 
ing images from a plurality of image sources, displaying the 
received images on a multi-screen of one display unit, an 
image source type determining step of determining a type of 
each of the image sources, a layout determining step of 4S 
determining a layout of display regions, for arranging the 
received images on the multi-screen of the display unit, a 
cursor generating step of generating a multi-screen control 
cursor for inputting commands on the multi-screen and 
operating the multi-screen control cursor, a display region 50 
identifying step of identifying a display region on the 
multi-screen of the display means in which the multi-screen 
control cursor is positioned, and a cursor control step of 
determining a role of the multi-screen control cursor in the 
display region where the multi-screen control cursor is 55 
positioned according to a type of an image source of an 
image displayed in the display region, and controlling gen- 
eration of the multi-screen control cursor- and -operation 
thereof so that the multi-screen control cursor can play the 
determined role. 60 

This enables the unified control of the images on the 
multi-screen. 

The multi-screen display system is preferably character- 
ized in that the plurality of image sources includes at least 
one image source providing an interactive operational 65 
environment, and the cursor control step sets a role of the 
multi-screen control cursor corresponding to the interactive 
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operational environment when an image source of an image 
displayed in the display region where the multi-screen 
control cursor is positioned provides the interactive opera- 
tional environment. This enables the control on the multi- 
screen suitably for the interactive operational environment. 

The multi-screen display method is preferably character- 
ized in that the at least one image source providing the 
interactive operational environment has a cursor generation 
controlling function of generating a cursor on the at least one 
image source and controlling operation of the cursor, and if 
the image source of the image displayed in the display 
region where the multi-screen control cursor is positioned 
has the cursor generation controlling function, the cursor 
control step transfers control relating to the generation and 
operation of the multi-screen control cursor to the cursor 
generation controlling function of the image source having 
the cursor generation controlling function so that the multi- 
screen control cursor is switched to the cursor generated by 
the image source having the cursor generation controlling 
function. The edition and change of the images at the image 
source side having the cursor generation controlling function 
can be performed on the multi-screen, not at the image 
source side. 

The image source having the cursor generation control- 
ling function is an information processing apparatus includ- 
ing a personal computer and a workstation. 

The multi-screen display method is characterized in that 
the image source having the cursor generation controlling 
function is provided with a serial bus, and the cursor control 
means has a serial bus connected to the serial bus of the 
image source, and wherein the cursor control step comprises 
reconstructing the connection of the serial bus of the cursor 
control means and the serial bus of the image source while 
the image source is operating, and then transferring the 
control relating to the generation and operation of the 
multi-screen control cursor to the cursor generation control- 
ling function of the image source. Therefore, the control 
relating to the generation and operation of the cursor can 
easily be transferred to the cursor generation controlling 
function of the image source. 

The serial bus of the image source and the serial bus of the 
cursor control means are universal serial buses or serial 
buses conforming to an IEEE 1394 standard. 

The multi-screen display method is characterized in that 
the plurality of image sources includes at least one image 
source having a cursor generation controlling function of 
controlling the cursor control means to generate an interac- 
tive cursor for moving and changing exclusively interactive 
select buttons, and wherein if the image source of the image 
displayed in the display region where the multi-screen 
control cursor is positioned has the cursor generation con- 
trolling function, the cursor control step turns off a display 
of the multi-screen control cursor to generate the interactive 
cursor according to the cursor generation controlling func- 
tion of the image source and controls operation of the 
interactive cursor. Therefore, change of the image sources 
and the like can be performed on the multi-screen. - 

The multi-screen display method is characterized in that 
the plurality of image sources includes at least one image 
source having a cursor generation controlling function of 
controlling the cursor control means to generate the multi- 
screen control cursor, and wherein if the image source of the 
image displayed in the display region where the multi-screen 
control cursor is positioned has the cursor generation con- 
trolling function, the cursor control step generates the multi- 
screen control cursor according to the cursor generation 
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controlling function of the image source and changes size, DETAILED DESCRIPTION OF THE 

color and movement amount of the multi-screen control PREFERRED EMBODIMENT 

cursor according to a resolution of the display region where ^ ^ ^ describe(J m ^ b 

the unage of the image source havmg the cursor generation of , e ^ reference t0 ^ a aD ^ ^winp. 

controlling function is displayed. Therefore, the cursor can 5 \ . , ,. . ^ 

be operated in a comfortable manner suitable for the screen. ?G. 1 15 " b,0 f k dm &* m show, °8 me of * 

* . . . - . . multi-screen display system according to a preferred 

The image source havmg the cursor generation control- embodinjent of & t mvention . 

ling function provides a digital broadcasting according to .an A , . „*, „ , ,. , 

integrated digital broadcasting system. . * shown , m ™- k ,be ^U-screcn display system 

JT ,~ ... ° ' . . . . . , _ 10 simultaneously displays images supplied from three inde- 

The multiscreen display method is preferably character- dent ^ (a M u for ISDB> 

ced m that if the mulu-screen control cursor on the mult.- t KUaaUDyD lc) on a mulU -screen of a display device 

screen-is located in a display region of the digital broad- ^ 

casting according to the integrated digital broadcasting * , . . .„ t e , 

system, the cursor control step converts a position of the descrmUon wiU now be given of the ISDB prior to a 

multi-screen control cursor to a position desired by a pro- » description .of the DTV receiving .pari 1 (hereinafter referred 

viderof the integrated digital broadcasting system, and if the !° as a receiving part) la for the ISDB. With the development 

converted position of the multi-screen control cursor is m digital techmques, an integrated services digital broad- 

within a region of a button property of changing interactive P"*** < ISDB > sv f m tordigmzmg '"formation including 

scenes, the cursor control step takes an action to change b /°^ cas . hav l b * e I n c ^ arched ^ developed m 

scenes according to a scenario of the digital broadcasting ™ the field of broadcasting. The ISDB system digitizes existing 

when received. Therefore, the scenes can be changed with- broadcasting signals (standard televjsion signals and high 

t vision signals), software and facsimile data and multimedia 

^ , , A , . . . .„ . information such as sounds, graphics and images, and inte- 

The above and other objects of the mvention will become ^ multi kxes thcm ^ lhe ISDB tem modu . 

more apparent from the following drawings taken in con- Jates ^ {n Wlth a transmission mode and then 

junction with the accompanying drawings. transmits them. When various information including broad- 

BRIEF DESCRIPTION OF THE DRAWINGS casting signals are multiplexed, it is possible to integrate and 

„ . . .itj- i_- lL t , - multiplex additional information to be used as control infor- 

FIG. 1 is a block diagram showing the structure of a . • ■ *j a * •* *u jjv i 

. . ... ^ ,. f ... aJ . mation at a receivmg side, and transmit the additional 

multi-scn^dBplay^systcm according to an embodiment of ^ ja&>mt&m „ , he time ^ ifflegrated ISDB broad . 

p ' casting signals (digital signals) are transmitted through 

FIG. 2 is a flow chart showing a process of displaying terrestrial waves, satellite waves, optical cables and the like, 

multi-images in the multi-screen display system in FIG. 1. A terminal receives the integrated ISDB broad- 

FIG. 3 is a flow chart showing a process of initializing a casting signals and distinguishes desired signals from others, 

display in a step S102 in FIG. 2. 35 Th c desired signals can be displayed on a monitor so that a 

FIG. 4 is a view showing a memory address map of image user can enjoy a normal TV broadcasting, and can be 

data in a memory part 14 of the multi-screen display system recorded and stored by a recording means and transferred to 

in FIG. 1. another terminal. Further, the received additional informa- 

FIG. 5 is a view showing an example of a screen when the uon can be used to control the monitor, control a recording 

multi-screen display system in FIG. 1 is initialized. 40 and process images displayed on the monitor according to 

FIG. 6 is a block diagram showing the structure of an me intentions. In short, an interactive broadcasting 

output composing part 18 of the multi-screen display system system can be constructed. 

in FIG. 1. The receiving part la has a tuner part 2, which receives 

FIG. 7 is a view showing an example of a screen for integrated ISDB broadcasting signals (digital signals) 

explaining a control cursor role changing function in the 45 through terrestrial waves, satellite waves, optical cables and 

multi-screen display system in FIG. 1. mc The receiving part la outputs the received signals 

FIG. 8 is a view showing a layout management table for to a demodulating part 3 via a band-pass filter, a down 

use in a control cursor role changing function in the multi- converter and the like. The demodulating part 3 demodulates 

screen display system in FIG 1. ^ S1 ^ i]s «=a>«fiog to the transmission mode, and corrects 

FIG. 9 is a flow chart showing a process of drawing a 50 errors or me lik f . t0 su PP lv a desired ^ P * G2 

cursor for controlling a multiple screen in an integrated stream to a mulhplex separation part 4. The mulUptex 

operation mode in the multi-screen display system in FIG. 1. Ration part divides the transport stream into MPEG2 

rnr* m ■ • u • i r • video data, audio data and additional information of a 

FIG 10 K a y.ew showing an example of a screen in a ^ ^ d£ , decodes ^ 

digrtaJ broao^asting for ISDB. ss MPEG2 audio dau and outputs an audio signal to a speaker 

FIG. 11 is a flow chart showing a process of drawing a a ^ im dccoding part 6 decodes me MPEG2 video 

cursor for the exclusive use of ISDB in a step S307 in FIG. data ^ ^ video data Mo , ras , ef „, display 

* format. Then, the video data as a broadcast image is inputted 

FIG. 12 is a view showing an example of a layout to the following moving image input part 8a. A data decod- 

conversion of an ISDB image. 60 ing part 7 decodes the MPEG2 additional information, and 

FIG. 13 is a view showing a cursor size changing table for outputs the additional information to a multi-screen control 

use in drawing a cursor for the exclusive use of ISDB. part 10. This means acquiring a scenario of a multimedia 

FIG. 14 is a view showing a cursor moving amount information service provider from an object written in a 

changing table for use in drawing a cursor for the exclusive scenario description language such as MHEG-5 and HTML, 

use of ISDB. 65 The scenario is composed of properties (e.g., size, position 

FIG. 15 is a flow chart showing a process of transferring and coding format) of constructed contents. The multi- 

a cursor function in a step S306 in FIG. 9. screen control part 10 interprets the scenario, and constructs 
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an ISDB data broadcast image in association with a graphic driving of the display and converts toe display format in 

accelerator 21 and the image decoding part 6. synchronism with a frame rate of a display device 16, 

The PC lb is a personal computer, a workstation or the Recording to characteristics of the display device 16, accord- 
like, and outputs image data, which is inputted to the moving m 8 t0 characteristics of the display device 16. 
image input part 8i> as analog signals or digital signals io a 5 , ^^a^y^^K^ eoapn^i^y iakM vml 
RGB raster format. The PCI* has a serial bus interface such < a P? 1 * 1 ■«* ■» al, 1 uid crystal display panel and a 
as USB (Universal Serial Bus) and IEEE 1394. TUe serial display panel) having a matnx electrode structure or 
bus executes a hot plug function. . a CRT (a catbode-ray tube). Moreqwafically, if the image 
F 6 source supplies a high-vision TV broadcasting, a large 

The DVD lc is a DVD unit for regenerating a DVD ROM display unit capable of displaying a high-vision image is 
and the like and outputs image data, which is inputted to the used as the display device 16, and if the image source is the 
moving image input part 8c as analog signals or digital pc, a large display unit capable of displaying a high- 
signals in a YUV raster format. precision image of SXGA or more is used as the display 

The moving image input part 8a receives the image data device 16. 
outputted from the image decoding part 6. The moving 15 The multi-screen control part 10 controls the entire multi- 
image input part 8fc receives the image data outputted from screen display system, and includes a CPU (not illustrated) 
the PC lb. The moving image input part 86 has an A/D that executes the control according to a control program 
converter and a PPL (Phase Locked Loop) circuit for sam- stored in a ROM 17, a counter (not illustrated) that counts 
pling the image data if the inputted image data is analog the elapsed time, a peripheral input/output interface (not 
signals. The moving image input part 8Z> has a decoding 2Q illustrated) and the like. The results of the operation and 
device and a differential buffer if the inputted image data is processing performed by the CPU are temporarily stored in 
digital signals such as LDVS (Low Voltage Differential a RAM 24. The ROM 17 contains a character font and the 
Signals). The moving image input part 8c receives the image like in addition to the control program. The character font is 
data outputted from the DVD lc. The moving image input used for displaying character information of WWW and data 
part 8c has a color conversion circuit for converting the ^ broadcasting. 

signals from YUV signals into RGB signals, an IP conver- The multi-screen control part 10 connects to a modem 

sion circuit for converting a scanning mode from an inter- control part 20 for connecting the system with an Internet, 

lace mode into a progressive mode, and the like if the a remote control controlling part 19 and a graphic accclera- 

inputted image data are composite signals of the television tor 21. The remote control controlling part 19 receives data 

and the DVD. The moving image input parts 8a, 8b, 8c 3Q such as commands transmitted from a remote control 23 

capture the image data from three image sources la, lb, lc through infrared rays. The remote control 23 is able to 

in different timings. At the same time as the capture of the transmit data such as commands through the infrared rays, 

image data, the moving image input parts 8a, &b, 8c capture The remote control controlling part 19 receives the data such 

control signals for capturing the image data; e.g., a horizon- as commands from the remote control 23, and transmits the 

tal synchronous signal for synchronizing one line, a vertical 35 data to a data conversion part 60. The data conversion part 

synchronous signal for synchronizing one frame or one field, 60 converts the data from the remote control part 19 into 

a clock signal for sampling a pixel, and a display enable serial packet data. In order to adjust a transfer timing of the 

signal indicating a transfer period of effective pixel data. packet data, the packet data is temporarily stored in a FIFO 

The image data captured into the moving image input (First In First Out) memory 61. The packet data stored in the 

parts 8a, 86, 8c are processed in a predetermined manner, ^ FIFO memory 61 is inputted to a serial bus interface 

and are then inputted to corresponding resolution converting (hereinafter referred to as a serial bus I/F) 62. The serial bus 

parts 9a, 9b, 9c. The resolution converting parts 9a, 9b 9 9c I/F 62 divides and converts the inputted packet data into a 

have a function of converting a display format (i.e., the format conforming to a predetermined serial bus standard 

number of display lines, the number of dots and the number such as USB (Universal Serial Bus) and IEEE 1394. The 

of colors) of the inputted image data under the control of the 4S acquired data is transmitted to the PC lb. 

multi-screen control part 10, and have a bus interface The graphic accelerator 21 has a function of issuing 

function of outputting the image data to a common graphic commands to draw a picture and accelerating BitBU, DMA 

bus 22. . and the like. This function is used when the multi-screen 

The image data outputted from the resolution converting control part 10 generates an OSD (On Screen Display), an 

parts 9a, 96, 9c is stored in a memory part 14, which has a 50 EPG (Electronic Program Guide), an ISDB screen and the 

capacity of at least four-screen display images, under the like on the display device 16. 

control of a memory control part 13, via a graphic bus 22. Referring next to FIGS. 2-6, a description will be given 

At the same time as the storage of the image data in the of a multi-screen display process in the multi-screen display 

memory part 14, the already-stored image data is read from system according to the present invention. FIG. 2 is a flow 

the memory part 14. When the already-stored image data is 55 chart showing the procedure for displaying the multi-image 

read, an output composition part 18 issues an address of the in the multi -screen display system in FIG. 1; FIG. 3, a flow 

image data to be displayed to the memory control part 13 in chart showing the procedure for initializing the display in a 

accordance with a multi-window management command - step S102 in FIG. 2; FIG. 4, a view showing a memory 

from the multi-screen control part 10, and the memory address map of the image data in the memory part 14 of the 

control part 13 reads the image data to be displayed from the 60 multi-screen display system in FIG. 1; FIG. 5, a view 

memory part 14. A bus arbitration part 12 scalably manages showing an example of a display on a screen when the 

this asynchronous access to the memory part 14 according to multi-screen display system in FIG. 1 is initialized; and FIG. 

the order of priority. 6, a block diagram showing the structure of the output 

The output composition part 18 receives the read image composition part 18 of the multi-screen display system in 

data, and composes the read image data to thereby generate 65 FIG. 1. 

final composite image data. The composite image data is As shown in FIG. 2, the multi-screen display system 

inputted to an output conversion part 15, which controls the checks whether a power supply is turned on or not in a step 
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SI 01. When the power supply is turned oo, the display is 
initialized in a step S202. 

Id the initialization of the display, the multi-screen display 
system detects the connection first so as to identify image 
sources connected thereto in a step S201 as shown in FIG. 
3. The image sources are identified by checking connection 
identification signals inputted from the image sources la, 
lb, lc to the corresponding moving image parts 8a, 86, 8c. 
The connection identification signals are captured into the 
multi-screen control part 10 through signal conductors 
Sl-o-c at regular time intervals. The connection identifica- 
tion signal is composed of a binary signal "1" or "0". If a 
cable for connecting the image source with the moving 
image input parts is pulled out, or if a power supply of the 
image source is turned off, the connection identification 
signal is "(T since the image input parts serve as a terminal 
resistance, thereby detecting that there is no input from the 
image source. In the following description, it is assumed that 
the connection identification signals are "1", and the image 
sources la, lb, lc are connected to the multi-screen display 
system. If the connection identification signals are "0", the 
connection identification signals are checked in the step 
S201 until they become "1". 

When the connection of the image sources is detected 
according to the connection identification signals, in a step 
S202, parameters (e.g., information relating to the number of 
display dots, the number of display lines and horizontal and 
vertical timings) are set for inputting moving images from 
the image sources, which are detected as being connected to 
the multi-screen display system. In this case, the parameters 
for inputting the moving images from the image sources 
detected as being connected are set by transmitting the 
detected parameters to the corresponding moving image 
input parts 8a, Sb, 8c through the signal conductors Sl-a-c. 
The parameters can also be found in such a manner that the 
moving image input parts directly count the number of 
clocks and the number of horizontal synchronous signals by 
using horizontal synchronous signals for synchronizing one 
line, vertical synchronous signals for synchronizing one 
frame or one field, clock signals for sampling one pixel, and 
the like. The information relating to the timing of inputting 
images from the connected image sources is captured into 
the multi-screen control part 10. 

Then, the process goes to a step S203 to determine a 
display layout on a screen, to which the images are inputted 
from at least one image source that is detected as being 
connected to the multi-screen display system. In the initial- 
ization of the display, the images are displayed in a layout 
of a predetermined default. In the following step S204, it is 
determined whether images are overlapped on the deter- 
mined display layout If images are overlapped, a display 
starting position and a display ending position, horizontal 
and vertical enlargement/reduction magnifications on the 
display device 16 of each image source are written in the 
RAM 24, and then the process goes to a step S205. If no 
images are overlapped, a display starting position and a 
.display ending position, horizontal and vertical enlargement/ 
reduction magnifications on the display device 16 of each 
image source are written in the RAM 24, and then the 
process goes to a step S206 skipping through the step S205. 

In the step S205, the priority of each layer in the overlap 
(a layer indicated at the top has the highest priority) is 
determined and is written in the RAM 24. 

In the step S206, resolution conversion parameters are 
determined, and the determined parameters are transmitted 
to the corresponding resolution conversion parts 9a, 9b, 9c 
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through signals conductors S2-o-<. Memory addresses 
required for writing outputs of the resolution conversion 
parts 9a, 9b, 9c into the memory part 14 are determined in 
a next step S207. In the present embodiment, the memory 

5 part 14 is composed of three screens for moving images and 
one screen for the OSD. When the outputs are stored in the 
memory part 14, the image is not yet on-screen. The 
multi-screen control part 10 transmits the starting addresses 

* 0-3 in FIG. 4 to the resolution conversion parts 9a, 9b, 9c 

10 and the graphic accelerator 21 through the signal conductors 
S2-o-c, and the starting addresses 0-3 are used as offset 
values for the memory addresses of each writing address 
generating part. 

Then, the process goes to a step S208 to set a background 

1S color (pattern) when a multi-window is displayed. More 
specifically, the background color is set in a background 
register 37 (see FIG. 6) of the output composition part 18. In 
a next step S209, the setting is performed to display the OSD 
for controlling the multi-screen. More specifically, the multi- 

20 screen control part 10 issues commands for drawing the 
OSD to the graphic accelerator 21, and writes characters and 
other data developed in a bit map format by the DMA 
function of the graphic accelerator 21 in the memory part 14. 
The layout of the OSD on the multi-screen is also deter- 

25 mined. In this case, the OSD has the highest priority. 

In a next step S210, reading addresses for reading the 
outputs of in the memory part 14 are set in a next step S210. 
A variety of matters are thus set for operating the output 
composition part 18. 

30 A brief description will now be given of the operation of 
the output composition part 18 with reference to FIG. 6. The 
output composition part 18 has a composition control part 
30. The composition control part 30 generates a variety of 
control signals acquired by the comparison between a hori- 

35 zontal pixel counter and a vertical line counter operating 
according to synchronous signals (Hsync, Vsync). The com- 
position control part 30 counts raster scans in a display 
period by capturing a horizontal counter starting value (a 
time from the Hsync to the start of an effective pixel) and a 

40 vertical line starting value (a time from the Vsync to the start 
of an effective line), and the number of horizontal pixels and 
the number of vertical lines, in response to a signal S3 from 
the multi-screen control part 10. With respect to addresses 
for reading the inputs to be composed (the inputs of the 

45 image source written in the memory part 14), the composi- 
tion control part 30 captures a composition starting address 
(an offset value from the start of effective counting of the 
composition control part 30) reflecting information on the 
layout of the image sources, the number of horizontal pixels 

50 and the number of vertical lines (these numbers are set in 
address generating parts 31—34) for respective screens, in 
response to the signal S3 from the multi-screen control part 
10. If the resulting values correspond to the counted values 
of the composition control part 30, the counting operation of 

55 the address generating parts 31-34 is kicked through signal 
conductors S5-o-o\ Therefore, the four address generating 
parts 31-34 count independently of one another. The counter 
is normally reset at intervals of Vsync. 

The counted values of the address generating parts 31-34 

60 are outputted as reading addresses directly to an address 
selecting part 35 through signal conductors 56-0-0*. In the 
present embodiment, different image sources are managed 
independently of one another in the construction of the 
screen, and thus, the images inputted from the image sources 

65 are composed by changing the addresses. More specifically, 
the images are composed in such a manner that the address 
selecting part 35 changes the addresses. In response to the 
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signal S3, the composition control part 30 captures the 
composition changing counted number according to the 
layout information and the priority information, and com- 
pares the captured counted values with the counted values of 
the counters in the composition control part 30. If they 
correspond to one another, the composition control part 30 
issues an address changing signal S7. Consequently, the data 
is read from the memory part 14, and the data read under the 
control of a write control signal S9 from the composition 
control part 30 is written in a data buffer 36. The data is read 
from the data buffer 36 under the control of a read control 
signal S9 from the composition control part 30, and the read 
data is 1 inputted to a data selecting part 40. If the compo- 
sition control part 30 determines that there is no data to be 
composed, it outputs a data changing signal S8 to the data 
selecting part 40, which outputs background data of the 
background color register 37. 

Then, the process goes to a step S211 to set for displaying 
the multi-screen control cursor. A description will now be 
given of how to draw the cursor. First, the multi-screen 
control part 10 determines a rectangular region where the 
cursor is displayed, and orders the graphic accelerator 21 to 
cover the region with a specific color (a key color). In 
response to the order, the graphic accelerator 21 writes the 
rectangular region in a cursor memory 38 in FIG. 6. On the 
other hand, the multi-screen control part 10 orders the 
graphic accelerator 21 to overlap a cursor pattern stored in 
the ROM 17 and the covered rectangular region. In response 
to the order, the graphic accelerator 21 performs an opera- 
tion to rewrite the rectangular region of the cursor memory 
38 into a cursor pattern with a chroma key. A write control 
signal S10 controls the writing of the rectangular region in 
the cursor memory 38. The multi-screen control part 10 sets 
a key color in a key color register in FIG. 6, and at the same 
time, specifies a position where the cursor is displayed in 
association with cursor control information transmitted from 
the remote control 23 and transmits cursor overlapping 
positional information calculated on the basis of the speci- 
fied display position to the composition control part 30. In 
order to compose the cursor, the composition control part 30 
outputs a cursor composition enable signal S12 to a cursor 
composition part 41. In this state, the composition control 
part 30 captures the composition change counted number on 
the basis of the cursor overlapping positional information 
and compares it with the counted value of the counter in the 
composition control part 30. If they correspond to each 
other, the composition control part 30 outputs a read control 
signal S10. The cursor data is added to the multi-screen 
composition data transmitted from the data selecting part 40 
by masking a key color part by the cursor composition part 
41, thereby acquiring all the composition data. The multi- 
screen display system is initialized in this manner. 

On completion of the initialization, the process goes to a 
step S103 in FIG. 2 to enable the display. At this time, the 
multi-screen is displayed on the display device 16 as shown 
in FIG. 5. 

Then, the process goes to a step S104 to check whether an 
enlarging/reducing action is inputted or not. If no, the 
process goes to a step S106 to check whether a position 
changing action is inputted or not. If no, the process goes to 
a step S108 to check whether a control cursor moving action 
is inputted or not. If no, the process goes to a step S110 to 
check whether a power supply turning-off action is inputted 
or not. If no, the processing from the steps S104 is repeated. 

If it is determined in the step S104 that the enlarging/ 
reducing action is inputted, the process goes to a step SI 05 
to expand/contract the display in accordance with the input- 
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ted enlarging/reducing action. A routine of this process is the 
same as the routine from the step S203 through S206 (the 
section (in FIG. 3). If it is determined in the step S106 that 
the position changing action is inputted, the process goes to 

5 a step S107 to change the position of the display in accor- 
dance with the inputted position changing action. The rou- 
tine of this process is the same as the routine from the steps 
S203 through S205 (the section (in FIG. 3). If it is deter- 
mined in the step S108 that the control cursor moving action 

10 is inputted, the process goes to a step S109 to change cursor 
parameters in accordance with the inputted control cursor 
moving action. The same process as in the step S2U is 
executed. If it is determined in the step S110 that the power 
supply turning-off action is inputted, the process is finished. 

15 As stated above, the multi-screen display system accord- 
ing to the present invention functions as a viewer that is 
capable of expanding/contracting the inputted plurality of 
images and changing the positions of the images. Moreover, 
the multi-screen display image display system is provided 

20 with the control cursor role changing function for operating 
each input screen having the interactive function from the 
multi-screen. 

A description will now be given of the control cursor role 
changing function with reference to FIGS. 7 and 8. FIG. 7 

25 is a view showing an example of a screen for explaining the 
control cursor changing function in the multi-screen display 
system in FIG. 1, and FIG. 8 is a view showing a layout 
management table for the control cursor changing function 

3o in the multi-screen display system in FIG. 1. 

To execute this function, the type of the image source 
connected to the system must be determined first with the 
detection of the connection in the step S201. To determine 
the type of the image source, a dip switch that may be 

35 designed according to the types of the image sources, and 
the type of the image source is determined according to a 
user's manual operation of the dip switch. To automatically 
determine the type of the image source, it can be considered 
that data is transmitted between the system and the PC 

^ through an IEEE 1394 port of a P&D connector proposed by 
VESA in the case where the PC lb is connected as the image 
source. The type of the receiving part la is determined in 
such a manner that the broadcasting industry defines an 
identifier in a transport stream in the future. 

45 Then, the multi-screen control part 10 manages the 
regions of the multi-screen when the layout is determined in 
the step S203. More specifically, in the case where the layout 
as shown in FIG. 7 is determined, the multi-screen control 
part 10 divides the display region of each inputted image 

50 into rectangular regions to create the layout management 
table in FIG. 8 in which starting point coordinates, ending 
point coordinates and detected types (the type does not have 
to be detected in the case of the OSD, which is created 
within the system of the present invention) are managed 

55 according to the regions. The layout management table is 
updated every time the layout is changed or the connected 
image source is changed. 

The display position coordinates of the multi-screen con- 
trol cursor generated in the step S211 are determined every 

60 time the control cursor is moved in the step S108. Thus, it 
is possible to determine in which region the multi-screen 
control cursor is located with reference to the display 
position coordinates and the layout management table. If the 
multi-screen control cursor is not located in any region, or 

65 if the multi-screen control cursor is located on a boundary 
between the regions, the cursor is determined as being 
located in a background region. Thus, the multi-screen 
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control cursor freely moves on the screen, and is used to 
change the display layout by changing the position of the 
screen and selecting an enlarging/reducing window and 
select the menu of the OSD. 

Referring next to FIG. 9, a description will be given of the 
process for drawing the multi-screen control cursor in an 
integrated operation mode in which the cursor parameters 
are changed in the step S109 shown in FIG. 2. FIG. 9 is a 
flow chart showing a process of drawing the cursor for 
controlling a multiple screen in the integrated operation 
mode. 

First, it is determined in a step S301 whether the inte- 
grated operation mode is set or not. The integrated operation 
mode is executed in response to the depression of an 
integrated operation button provided in the remote control 
23. In the integrated operation mode, the role of the multi- 
screen control cursor is changed according to the region 
where it is located (the type of the image source of the 
image) in order to operate each input screen having the 
interactive function. 

If the integrated operation mode is not set, the process 
goes to a step S302 to draw the multi-screen control cursor 
normally. 

If the integrated operation mode is set, the process goes to 
a step S303 to determine whether the multi-screen control 
cursor is located in an OSD region (a region #4 in FIG. 7) 
or not. If the multi-screen control cursor is located in the 
OSD region, the process goes to the step S3 02 to draw the 
multi-screen control cursor normally. If the multi-screen 
control cursor is not located in the OSD region, the process 
goes to a step S304. 

It is determined in the step S304 whether the multi-screen 
control cursor is located in a PC region (regions #0, 1 in FIG. 
7) or not. If the multi-screen control cursor is located in the 
PC regions (the regions #0, 1 in FIG. 7), the process goes to 
a step S3 06. Since the PC has a cursor generation controlling 
function for generating and operating a cursor on the screen, 
the cursor function is transferred to the cursor function to the 
cursor generation control function of the PC. Then, the 
process is finished. The process of transferring the cursor 
function will be described later. 

If it is determined in the step S304 that the multi-screen 
control cursor is not located in the PC regions, the process 
goes to a step S305 to determine whether the multi-screen 
control cursor is located in DTV regions (regions #2, 3 in 
FIG. 7) or not. If the multi-screen control cursor is not 
located in the DTV regions, the process goes to the step 
S3 02. If the multi-screen control cursor is located in the 
DTV regions, the process goes to a step S3 07 to draw the 
ISDB cursor. Then, the process is finished. The process of 
drawing the ISDB cursor will be described later. 

To exit the integrated operation mode, the integrated 
operation mode of the remote control 23 is pressed again to 
cancel the integrated operation mode, so that the system can 
shift to the normal multi-screen control cursor control mode 
in the step S302. 

Referring next to "FIG. 15, a description will be given of 
the process of transferring the cursor function in the step 
S306. FIG. 15 is a flow chart showing the process of 
transferring the cursor function in the step S306 shown in 
FIG. 9. 

As shown in FIG. 15, whether the user requires the cursor 
function to be transferred to the PC or not is monitored in the 
PC regions in a step S601. When the user presses a transfer 
key of the remote control 23, the remote control controlling 
part 19 recognizes a command generated according to the 
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depression of the transfer key, and instructs the multi-screen 
control part 10 to transfer the cursor function. Accordingly, 
the multi-screen control part 10 determines that the user 
requires the cursor function to be transferred to the PC, and 

5 goes to a step S602 to disable the composition of the 
multi-screen control cursor according to a cursor composi- 
tion enable signal S12, thereby setting off the drawing 
operation of the multi-screen control cursor. 
Then, the process goes to a step S&03 to inform the remote 

10 control controlling part 19 that the system is in a transfer 
mode through a signal S20. Accordingly, the remote control 
controlling part 19 is ready to accept only commands in the 
transfer mode (e.g., a keyboard command for controlling the 
PC, a mouse coordinate command and a transfer cancella- 

15 tion command). Then, the process goes to a step S604 to 
reconstruct the serial connection with the PC. More 
specifically, a serial bus I/F 62 is controlled by the signal S4 
to disconnect the serial bus once and then connect the serial 
bus again, and activate an inner timer for measuring a time 

20 required for the reconstruction. Therefore, the PC serves as 
a host on the serial bus and the system serves as a device in 
a serial protocol of the USB (or the IEEE 1394), and this 
completes the reconstruction using the bot plug function of 
the serial connection. 

25 Then, the process goes to a step S605 to wait for a counted 
value of the inner timer to become larger than a predeter- 
mined counted value of the reconstruction time. When the 
counted value of the inner timer exceeds the predetermined 
counted value of the reconstruction time, it is determined 

30 that the transfer of the cursor function in the system is 
completed. In this state, the PC as the host accepts the cursor 
control and the input operation from the remote control 23. 
On the display screen of the system, the picture drawn by the 
cursor generation controlling function of the PC is displayed 

55 as a part of image data. More preferably, the system is 
provided with a wireless keyboard and a wireless mouse 
instead of the remote control 23, and the control directions 
are switched between the wireless keyboard and the wireless 
mouse. This provides the user with the excellent operational 

4Q environment. 

In a step S606, the issuance of the cursor function transfer 
cancellation function is only monitored, and in a step S607, 
it is determined whether the cursor function transfer can- 
cellation command is detected or not. If no, the process 

45 returns to the step S606 to continue the issuance of the 
cursor function transfer cancellation command When the 
user presses a transfer cancellation button in the remote 
control 23, the remote control controlling part 19 recognizes 
a command corresponding to the depression of the transfer 

50 cancellation button, and issues the cursor transfer cancella- 
tion command to the multi-screen control part 10. When the 
cursor function transfer cancellation command is detected, 
the process goes to a step S608 to cancel the serial connec- 
tion with the PC by controlling the serial bus I/F 62 with the 

55 signal S4. 

Then, the process goes to a step S609 to inform the remote 
control controlling part 18 that the system has returned to the 
integrated operation mode through the signal S20. 
Accordingly, the remote control controlling part 19 is ready 

60 to accept all commands in the integrated operation mode. 
Then, the process goes to a step S610 to enable the com- 
posite display of the multi-screen control cursor with the 
cursor composition enable signal S12. Thus, the drawing of 
the multi-screen control cursor is set on, so that the system 

65 can return from the transfer mode. 

If the multi -screen control cursor is located in the display 
region of the PC lb, this is automatically detected to transfer 
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the control relating to the generation and operation of the changed to (X", 0), (0, Y"). The conversion is expressed by 

multi-screen control cursor to the control of the PC 16. This the following equations (3) and (4): 

realizes the remote integrated operation on the multi-screen (3) 

showing the image of the image source such as the PC y"-y+ny u) 

having the cursor generating function. 5 

_ . . r^^r, ^ t ^ , , The layout coordinates are converted by converting the 

Referring next to FIGS. 10 and 11 a description i will be rcsolution and charjgiDg ^ position by mc abovc equations 

given of the integrated operation of the digital broadcasting (l)-(4) *s follows: 
• for the ISDB. FIG. 10 is a view showing an example of a 

screen of the digital broadcasting for the ISDB; FIG. 11 is X"-MX+Xm (5) 

a view showing a process of drawing the ISDB cursor in the 10 r-NY+Ym (6) 

step S307 in FIG. 9; FIG. 12 is a layout conversion image The positional information of the ISDB screen laid out 

of an ISDB image; FIG. 13 is a view showing a cursor size according to the above equations (5) and (6) are converted 

changing table for use in drawing the ISDB cursor; and FIG. into the display on the multi-screen to draw the cursor. 

14 is a view showing a cursor movement amount changing Referring next to FIG. 11, a detailed description will be 

table for use in drawing the ISDB cursor. 15 given of the process in the step S307 in the integrated 

First, a description will be given of a method for produc- ^he^t^rilti-screen control cursor is located in DTV 
ing a screen of the digital broadcasting for the ISDB. rcgions (fCgions #2f 3 m mG ^ tbe , SDB cursof fc 

The screen of the digital broadcasting for the ISDB is in the step S307 as stated above. To draw the ISDB cursor, 
created as shown in FIG. 10. To display the intended screen, 20 it is determined first in a step S501 whether tbe ISDB cursor 
a broadcasting station transmits a background, a moving must ^ displayed or not as shown in FIG. 10. In this 
image, data, a menu button, and the like as objects in a embodiment, an arrow cursor is used as the multi-screen 
multimedia language, such as MHEG-5. Each object has control cursor as shown in FIG. 10. If the broadcasting 
properties such as a position, a size, a button, a bit map and station instructs the ISDB cursor to be displayed (e.g., an 
a text. The image display system of this invention generates 25 outline of a button region is framed by a specific color, and 
the objects other than the moving image of an MPEG2 from mc entire button region is inverted in color), or if the type 
the property information in the same manner as the OSD is of tnc cursor is desired to be changed intentionally; it is 
generated. The moving image of the MPEG2 is regenerated determined that the ISDB cursor should be displayed. The 
using a system from the image decoding part 6 to the process goes to a step S502 to cancel the display of the 
resolution conversion part 9a in FIG. 1, and a screen 30 multi-screen control cursor. More specifically, the cursor 
intended by the broadcasting station as shown in FIG. 10 can composition enable signal S12 in FIG. 6 disables the com- 
be created by composing the moving image by the output position of the multi-screen control cursor, 
composition part 18 in the previouslyKiescribed manner. In Then, the process goes to a step S503 to display the ISDB 
the regeneration, the resolution of the MPEG2 is converted cursor. If a frame cursor is used, the positions and number 
into such a resolution as to reduce the image into a desig- 35 °f bullous are recognized from a scenario descriptive lan- 
nated size. The above-mentioned sequence is an example guagc (if there are a plurality of buttons, all the buttons are 
wherein the image is expressed in a resolution intended by recognized), and a frame cursor is displayed for a default 
the broadcasting station. button. 

TC 4 . ,™„ *- 1 1 j , As is the case with the OSD, a rectangular button frame 

If the ISDB screen is handled as one screen on the „ is pamt ed out in a specific color and the button is drawn on 

multi-screen in the multiscreen display 'system, the layout me ^ buUoD frame Tfae frame CUISOf fe moyed b 

must ^ cha^d * » method described below with refer- on/off me dfawing of ^ frame cursor fof the 

ence to . . recognized buttons in a predetermined order in connection 

When the ISDB screen is handled in the multi-screen with the button of the remote control 23. 
display system according to the present invention, a screen 45 If it is determined in the step S501 that there is no 
50 is displayed as one screen on the multi-screen in a display necessity of displaying tbe cursor for the ISDB, the process 
resolution intended by the broadcasting station. If the dis- goes to a step S504 to set a cursor size. More specifically, the 
play resolution intended by the broadcasting station is X size of the ISDB button is determined first, and the size of 
pixels in a horizontal pixel direction and Y lines in a vertical the multi-screen control cursor for controlling the entire 
line direction, the screen 50 is expressed by coordinates (X, 50 system is set so as to make it possible for the user to select 
0), (0, Y). If the user changes the layout to display the a desired button without fail. If there is no necessity of 
multi-screen, the layout must be converted into a designated changing the cursor size, the present cursor size is main- 
size or the position of the layout must be changed. If the tained. 

resolution is converted in such a manner that the screen is A cursor color is set in a next step S505. This aims at 

magnified by M (1>M>0) in the horizontal direction and by 55 making it easier for the user to recognize that the system is 

N (1>N>0) in the vertical direction, the screen 51 is changed currently in an ISDB operation mode. Thus, a different color 

m to a screen 51 . The coordinates thereof is (X', 0), (0, V). The from that of the multi-screen control cursor is set. If there is 

conversion is expressed by the following equations (1) and no necessity of changing the color, the current color is 

(2): maintained. 

60 Then, the process goes to a step S506 to set a cursor 

r-MX (i) movement amount. If it is more convenient to change the 

cursor movement amount on the ISDB screen in the normal 

y=ny (2) multi-screen control, the cursor movement amount is 

changed. If there is no necessity of changing the cursor 

To change the position from the origin (0, 0) to an 65 movement amount, the movement amount is maintained at 

movement offset (Xm, Ym), the screen 51 moves to the a current value. In a next step S507, the position of the 

position of a screen 52, and the coordinates thereof are operation button is recorded. This aims at enabling the 
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multi-screen control part 10 to recognize a scene changing 
timing when a button selecting action is taken by operating 
the remote control 23 in the case where the cursor is located 
in the button region on the ISDB screen. 

To change the setting as described later, the setting in the 5 
above-mentioned steps $504 through SS07 is referred to as 
the base setting of the ISDB cursor display. 

Then, ihc process goes to a step S508 to determine 
whether to display the ISDB image by 1 magnification 
according to a layout proposed by the broadcasting station. 10 
When the image is displayed by 1 magnification, the process 
goes to a step S509, wherein the setting on the multi-screen 
is changed according to the above setting. If the image is not 
displayed by 1 magnification, it is determined that the user 
intentionally changes the layout to display the multi-screen, is 
TTien, the process goes to a step S510 to determine whether 
to convert the resolution. If the resolution is converted, the 
process goes to a step S511 to change the cursor size 
correspondingly to the ISDB screen with the converted 
resolution with reference to a cursor size changing table. As 20 
shown in FIG. 13, the cursor size changing table shows a 
relationship between the cursor size and the magnification. 
In this embodiment, the cursor size determined in the step 
S504 is regarded as a reference value with respect to 1 
magnification. As is apparent from the table, the cursor size 25 
is gradually increased with the increase in the magnification. 

In a next step S512, the cursor movement amount is 
changed suitably for the ISDB screen with the converted 
resolution. The cursor movement amount is changed with 
reference to a cursor movement amount changing table. As 30 
shown in FIG. 14, the cursor movement amount changing 
table shows a relationship between the cursor movement 
amount and the magnification. Id this embodiment, the 
cursor movement amount shows a relationship between the 
cursor size and the magnification with the cursor movement 35 
amount set in the step S506 being a reference value with 
respect to 1 magnification. As is clear from the table, the 
cursor movement amount is gradually increased with the 
increase in the magnification. 

Then, the process goes to a step S513 to change the 40 
memorized position of the operation button in accordance 
with the change in the layout by substituting (Xm, Ym)=(0, 
0) for the offset coordinates in the equations (5) and (6). 
Then, the process goes to a step S514. 

If it is determined in the step S510 that the resolution will 45 
not be converted, the process goes to a step S514 skipping 
through the step S511-S513. In the step S514, it is deter- 
mined* whether the position of the operation button is to be 
changed or not. If it is determined that the position of the 
operation button is to be changed, the process goes to a step 50 
S515 to again change the memorized position of the opera- 
tion button according to the change in the layout by substi- 
tuting M=N=0 for the magnifications in the above equations 
(5) and (6). Then, the steps goes to the step S509. If it is 
determined in the step S514 that the position of the operation 55 
button is not to be changed, the process goes to the step S509 
skipping through the step S515. 

When the "user selects a button on the ISDB screen whose 
layout has been changed on the multi-screen to take an 
interactive action, the multi-screen control part 10 returns 60 
the changed position of the cursor from (X", Y") to (X, Y) 
intended by the broadcasting station in accordance with the 
following equations (7) and (8) obtained from the above 
equation (3): 

65 

X=QrXm)!M (7) 
Y={Y~Ym)IN (8) 
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The returned position and the region having the button 
properties are compared and monitored. If they correspond 
to one another, the action is regarded as the button selecting 
action. Accordingly, the corresponding button is selected. 
Therefore, the scenes can be changed properly on the 
multi-screen. 

As stated above, when the multi-screen control cursor is 
located within the DTV clisplay regions, this is automatically 
detected to change the type, size, color and movement 
amount of the cursor. This provides the optimum operational 
environment corresponding to the mode of the operation. 
Even when the layout of the multi-screen is changed, the 
selection of the interactive button can be recognized accu- 
rately to change the scenes properly. This realizes the 
integrated operation on the multi-screen that displays the 
DTV images for the ISDB. 

It should be understood, however, that there is no inten- 
tion to limit the invention to the specific forms disclosed, but 
on the contrary, the invention is to cover all modifications, 
alternate constructions and equivalents falling within the 
spirit and scope of the invention as expressed in the 
appended claims. 

What is claimed is: 

1. A multi-screen display system comprising: 

input means for inputting images from a plurality of 
image sources; 

display means having a multi-screen capable of display- 
ing the inputted images; 

image source determining means for determining a type 
of each of said image sources; 

layout determining means for determining a layout of 
display regions for arranging the inputted images on 
said mul Li -screen of said display means; 

cursor control means for generating a multi-screen control 
cursor for inputting commands on said multi-screen 
and controlling operation thereof; and 

display region identifying means for identifying a display 
region on said multi-screen of said display means in 
which said multi-screen control cursor is positioned; 
and 

wherein said cursor control means determines a role of 
said multi-screen control cursor in the display region 
where said multi-screen control cursor is positioned 
according to a type of an image source of an image 
displayed in the display region, and said cursor 
control means controls generation of said multi- 
screen control cursor and the operation thereof so 
that said multi-screen control cursor can play the 
determined role. 

2. A multi-screen display system as defined in claim 1, 
wherein said plurality of image sources includes at least one 
image source providing an interactive operational 
environment, and said cursor control means sets a role of 
said multi-screen control cursor corresponding to the inter- 
active operational environment when an image source of an 
image displayed in the display region where said multi- 
screen control cursor is positioned provides the interactive 
operational environment. 

3. A multi-screen display system as defined in claim 1, 
wherein said at least one image source providing said 
interactive operational environment has a cursor generation 
controlling function of generating a cursor on said at least 
one image source and controlling operation of said cursor, 
and said cursor control means has control transfer means 
operable if the image source of the image displayed in the 
display region where said multi-screen control cursor is 
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positioned has said cursor generation controlling function, 
for transferring control relating to the generation and opera- 
tion of said multi-screen control cursor to said cursor 
generation controlling function of said image source having 
said cursor generation controlling function so that said 5 
multi-screen control cursor is switched to said cursor gen- 
erated by the image source having said cursor generation 
controlling function. 

4. A multi-screen display system as defined in claim 3, 
wherein said image source having said cursor generation 10 
controlling function is an information processing apparatus 
including a personal computer and a workstation. 

5. A multi-screen display system as defined in claim 3, 
wherein said image source having said cursor generation 
controlling function is provided with a serial bus, and said 15 
cursor control means has a serial bus connected to said serial 
bus of said image source; 

said control transfer means reconstructs the connection of 
said serial bus of said cursor control means and said 
serial bus of said image source while said image source 20 
is operating, and then transfers the control relating to 
the generation and operation of said multi-screen con- 
trol cursor to said cursor generation controlling func- 
tion of said image source. 

6. A multi-screen display system as defined in claim 5, 25 
wherein said serial bus of said image source and said serial 
bus of said cursor control means are universal serial buses or 
serial buses conforming to an IEEE 1394 standard. 

7. A multi-screen display system as defined in claim 2, 
wherein said plurality of image sources includes at least one 30 
image source having a cursor generation controlling func- 
tion of controlling said cursor control means to generate an 
interactive cursor for moving and changing exclusively 
interactive select buttons, and wherein if the image source of 
the image displayed in the display region where said multi- 35 
screen control cursor is positioned has said cursor generation 
controlling function, said cursor control means turns off a 
display of said multi-screen control cursor to generate said 
interactive cursor according to said cursor generation con- 
trolling function of said image source and controls operation 40 
of said interactive cursor. 

8. A multi-screen display system as defined in claim 2, 
wherein said plurality of image sources includes at least one 
image source having a cursor generation controlling func- 
tion of controlling said cursor control means to generate said 45 
multi-screen control cursor, and wherein if the image source 

of the image displayed in the display region where said 
'multi-screen control cursor is positioned has said cursor 
generation controlling function, said cursor control means 
generates said multi-screen control cursor according to said 50 
cursor generation controlling function of said image source 
and changes size, color and movement amount of said 
multi-screen control cursor according to a resolution of said 
display region where said image of said image source having 
said cursor generation controlling function is displayed. 55 

9. A multi-screen display system as defined in claim 7, 
wherein said image source having said cursor generation 
controlling function provides a digital broadcasting accord- 
ing to an integrated digital broadcasting system. 

10. A multi-screen display system as defined in claim 8, 60 
wherein said image source having said cursor generation 
controlling function provides a digital broadcasting accord- 
ing to an integrated digital broadcasting system. 

11. A multi-screen display system as defined in claim 9, 
wherein if said multi-screen control cursor on said multi- 65 
screen is located in a display region of said digital broad- 
casting according to said integrated digital broadcasting 
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system, said cursor control means converts a position of said 
multi-screen control cursor to a position desired by a pro- 
vider of said integrated digital broadcasting system, and 
wherein if the converted position of said multi-screen con- 
trol cursor is within a region of a button property of 
changing interactive scenes, said cursor control means takes 
an action to change scenes according to a scenario of the 
digital broadcasting when received. 

12. A multi-screen display system as defined in claim 10, 
wherein if said multi-screen control cursor on said multi- 
screen is located in a display region of said digital broad- 
casting according to said integrated digital broadcasting 
system, said cursor control means converts a position of said 
multi-screen control cursor to a position desired by a pro- 
vider of said integrated digital broadcasting system, and 
wherein if the converted position of said multi-screen con- 
trol cursor is within a region of a button property of 
changing interactive scenes, said cursor control means takes 
an action to change scenes according to a scenario of the 
digital broadcasting when received. 

13. A multi-screen display method which comprises: 

a receiving step of receiving images from a a plurality of 

image sources; 
displaying the received images on a multi-screen of one 

display unit; 

an image source type determining step of determining a 
type of each of said image sources; 

a layout determining step of determining a layout of 
display regions, for arranging the received images on 
said multi -screen of said display unit; 

a cursor generating step of generating a multi-screen 
control cursor for inputting commands on said multi- 
screen and operating said multi-screen control cursor; 

a display region identifying step of identifying a display 
region on said multi-screen of said display means in 
which said multi-screen control cursor is positioned; 
and 

a cursor control step of determining a role of said multi- 
screen control cursor in the display region where said 
multi-screen control cursor is positioned according to a 
type of an image source of an image displayed in said 
display region, and controlling generation of said 
multi-screen control cursor and operation thereof so 
that said multi-screen control cursor can play the deter- 
mined role. 

14. A multi-screen display system as defined in claim 13, 
wherein said plurality of image sources includes at least one 
image source providing an interactive operational 
environment, and said cursor control step sets a role of said 
multi-screen control cursor corresponding to the interactive 
operational environment when an image source of an image 
displayed in the display region where said multi-screen 
control cursor is positioned provides the interactive opera- 
tional environment. 

15. A multi-screen display method as defined in claim 14, 
wherein said at least one image source providing said 
interactive operational environment has a'cursor generation 
controlling function of generating a cursor on said at least 
one image source and controlling operation of said cursor, 
and wherein if the image source of the image displayed in 
the display region where said multi-screen control cursor is 
positioned has said cursor generation controlling function, 
said cursor control step transfers control relating to the 
generation and operation of said multi-screen control cursor 
to said cursor generation controlling function of said image 
source having said cursor generation controlling function so 
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that said multi-screen control cursor is switched to said 
cursor generated by the image source having said cursor 
generation controlling function. 

16. A multi -screen display method as defined in claim 15, 
wherein said image source having said cursor generation 5 
controlling function is an information processing apparatus 
including a personal computer and a workstation. 

17. A multi -screen display method as defined in claim 16, 
wherein said image source having said cursor generation 
controlling function is provided with a serial bus, and said to 
cursor control means has a serial bus connected to said serial 
bus of said image source, and wherein said cursor control 
step comprises reconstructing the connection of said serial 
bus of said cursor control means and said serial bus of said 
image source while said image source is operating, and then 15 
transferring the control relating to the generation and opera- 
tion of said multi-screen control cursor to said cursor 
generation controlling function of said image source. 

18. A multi-screen display method as defined in claim 17, 
wherein said serial bus of said image source and said serial 20 
bus of said cursor control means are universal serial buses or 
serial buses conforming to an IEEE 1394 standard. 

19. A multi-screen display method as defined in claim 14, 
wherein said plurality of image sources includes at least one 
image source having a cursor generation controlling func- 25 
tion of controlling said cursor control means to generate an 
interactive cursor for moving and changing exclusively 
interactive select buttons, and wherein if the image source of 
the image displayed in the display region where said multi- 
screen control cursor is positioned has said cursor generation 30 
controlling function, said cursor control step turns off a 
display of said multi-screen control cursor to generate said 
interactive cursor according to said cursor generation con- 
trolling function of said image source and controls operation 

of said interactive cursor. 35 

20. A multi -screen display method as defined in claim 14, 
wherein said plurality of image sources includes at least one 
image source having a cursor generation controlling func- 
tion of controlling said cursor control means to generate said 
multi-screen control cursor, and wherein if the image source 40 
of the image displayed in the display region where said 
multi-screen control cursor is positioned has said cursor 
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generation controlling function, said cursor control step 
generates said multi-screen control cursor according to said 
cursor generation controlling function of said image source 
and changes size, color and movement amount of said 
multi-screen control cursor according to a resolution of said 
display region where said image of said image source having 
said cursor generation controlling function is displayed. 

2 V A multi-screen display system as defined in claim 19, 
wherein said image source having said cursor generation 
controlling function provides a digital broadcasting accord- 
ing to an integrated digital broadcasting system. 

22. A multi-screen display method as defined in claim 20, 
wherein said image source having said cursor generation 
controlling function provides a digital broadcasting accord- 
ing to an integrated digital broadcasting system. 

23. A multi-screen display method as defined in claim 21, 
wherein if said multi-screen control cursor on said multi- 
screen is located in a display region of said digital broad- 
casting according to said integrated digital broadcasting 
system, said cursor control step converts a position of said 
multi-screen control cursor to a position desired by a pro- 
vider of said integrated digital broadcasting system, and 
wherein if the converted position of said multi-screen con- 
trol cursor is within a region of a button property of 
changing interactive scenes, said cursor control step takes an 
action to change scenes according to a scenario of the digital 
broadcasting when received. 

24. A multi-screen display method as defined in claim 22, 
wherein if said multi-screen control cursor on said multi- 
screen is located in a display region of said digital broad- 
casting according to said integrated digital broadcasting 
system, said cursor control step converts a position of said 
multi-screen control cursor to a position desired by a pro- 
vider of said integrated digital broadcasting system, and 
wherein if the converted position of said multi-screen con- 
trol cursor is within a region of a button property of 
changing interactive scenes, said cursor control step takes an 
action to change scenes according to a scenario of the digital 
broadcasting when received. 

***** 
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